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© Method of displaying navigation data for a vehicle In an Image of the vehicle environment, a 
navigation system for performing the method, and a vehicle comprising a navigation system. 



® From navigation data of a vehicle there is 
formed an indication signal which is superposed on 
an image of the local environment which is gen- 



. erated by an image pick-up unit. The combination is 
displayed on a display unit. 
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METHOD OF DISPLAYING NAVIGATION DATA FOR A VEHICLE IN AN IMAGE OF THE VEHICLE ENVIRON- 
MENT, A NAVIGATION SYSTEM FOR PERFORMING THE METHOD, AND A VEHICLE COMPRISING A 

NAVIGATION SYSTEM. 



BACKGROUND OF THE INVENTION 

The invention relates to a method of displaying 
navigation data for a vehicle in an image of the 
local vehicle environment 5 

The invention also relates to a navigation sys- 
tem suitable for performing such a method, and to 
a vehicle comprising such a navigation system. 

A method of this kind is known from the article 
"New frontiers for Detroit's Big Three", RonaJd K. w 
Jurgen, IEEE Spectrum, October 1988, p. 32. The 
cited article describes a method where navigation 
data for a vehicle, for example a digital speed 
reading, low-fuel warning, etc. is projected onto the 
windshield and thus combined with the view of the is 
driver of the car. Information from a number of 
sensors is processed by an electronic module so 
as to form signals which are applied to a vacuum- 
fluorescent tube, after which optical elements pro- 
ject the light from activated segments of the tube 20 
onto the windshield of the vehicle. The driver sees 
virtual images which appear to float in the vicinity 
of the front of the car. 

It is a drawback of such a method that its possibili- 
ties are limited. The navigation data can be dis- 25 
played in a small area only, because display in an 
area covering the field of view of the driver, for 
example an area having the dimensions of a wind- 
shield of a car, is difficult to realise and expensive. 
Coverage of the entire windshield requires notably 30 
a large angle of aperture of the optical system and 
is hence problematic and expensive. 



SUMMARY OF THE INVENTION 35 

It is inter alia an object of the invention to 
provide a method of displaying navigation data for 
a vehicle in an image of the local vehicle environ- 
ment which allows for a simple, user-friendly and aq 
readily interpretable display of the navigation data. 
To achieve this, a method in accordance with the 
invention is characterized in that an image of the 
local environment is generated by an image pick- 
up unit, which image is displayed on a display unit, as 
an indication signal formed from the navigation 
data being superposed on the image. The image 
pick-up unit picks up the most relevant environ- 
ment as chosen by the driver, for example the road 
ahead of the vehicle, thus producing a very realistic so 
image of the environment on a display unit It has 
been found that such an image is more user- 
friendly than an abstract representation, for exam- 



ple in the form of pictograms. Because of the 
superposition of an indication signal formed from 
the navigation data, this signal overlaps the image 
on the display unit. The navigation data indicates, 
for example the speed or the remaining fuel re- 
serve, but may also consist of one or more indica- 
tion such as arrows indicating a direction to be 
followed. 

One version of a method in accordance with 
the invention where the navigation data is gen- 
erated by a navigation system on the basis of 
measurement data from sensors and/or topograph- 
ic data from a data structure, is characterized in 
that before formation of the indication signal, the 
navigation data is transformed in conformity with a 
position of the image pick-up unit with respect to 
the environment 

The navigation data can thus be combined with the 
image so that the user is optimally informed at a 
single glance. For example, when approaching an 
intersection the direction to be followed, calculated 
by the car navigation system, can be indicated by 
an arrow overlaid on the road section to be fol- 
lowed on the display unit. The traffic situation can 
thus be particularly quickly and easily interpreted. 

A further version of a method in accordance 
with the invention is characterized in that the navi- 
gation data is transformed by way of a perspective 
transformation. By superposing the navigation data 
in perspective on the image, a readily interpretable 
user-friendly display which corresponds to reality is 
obtained. The fact that a road section to be taken is 
obscured by buildings and the like can then be 
taken into account, provided that such data is in- 
cluded in the data structure. 

A further version of a method in accordance 
with the invention is characterized in that the dis- 
play unit displays the navigation data so as to be 
distinct. This enhances the clarity of the display. 

A preferred version of a method in accordance 
with the invention, where the navigation data is 
generated by a navigation system on the basis of 
measurement data from sensors and topographic 
data from a data structure in which roads are 
represented by coordinates of their centre lines, is 
characterized in that prior to the formation of the 
indication signal from the navigation data, the re- 
presentation of the roads is converted into a repre- 
sentation by polygons. 

Using this polygon representation, the indication 
signal can be adapted better to the image of the 
environment; the true width of the roads then be- 
comes apparent. For example, arrows indicating 
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the direction to be followed can be displayed in the 
centre of the lane to be followed. 

A navigation system which is suitable for per- 
forming a method in accordance with the invention 
is characterized in accordance with the invention in 
that the navigation system comprises an image 
pick-up unit which generates an image of the local 
environment, a transformation module for trans- 
forming navigation data generated by the naviga- 
tion system, a video generator for generating an 
indication signal from the transformed navigation 
data, a combination module for combining the im- 
age of the environment and the indication signal so 
as to form a combined signal, and a display unit for 
displaying the combined signal. 



BRIEF DESCRIPTION OF THE FIGURES 

Fig. 1 shows a flowchart of a method in accor- 
dance with the invention; 

Fig. 2 diagrammatically shows the structure of a 
navigation system suitable for performing the 
method in accordance with the invention; 
Fig. 3 shows examples of a local image for 
display on a display unit in combination with 
navigation data; 

Fig. 4 illustrates the data structure used; 

Fig. 5 illustrates the sorting of the connections; 

Fig. 6 illustrates the conversion into polygons. 

DESCRIPTION OF THE FIGURES 
Fig. 1 shows a flowchart of a method in accor- 
dance with the invention. In block 11 an image of 
the environment is generated by means of an im- 
age pick-up unit, for example a video camera 
aboard a vehicle. In block 12, known from the 
article "CARIN, a car information and navigation 
system" by M.L.G. Thoone, Philips Technical Re- 
view, Vol. 43. No. 11/12, pp. 317-329, December 
1987, the navigation data to be displayed therein 
are generated; in block 13 an indication signal is 
formed therefrom, for example by means of a 
known video generator, which indication signal is 
superposed in block 1 4, for example by means of a 
video combination module, on the environment im- 
age. In block 15 the combination is displayed on a 
display unit, for example a video display, a televi- 
sion receiver or a monitor, aboard the vehicle. 

Fig. 2 diagrammatically shows the structure of 
a navigation system suitable for performing the 
method in accordance with the invention. Module 
21 is a known car navigation system, for example a 
CARIN system as described in the cited article by 
M.LG. Thoone, which supplies navigation data on 
the basis of measurement data from sensors (such 
as a compass and wheel sensors which measure 
the number of revolutions) and topographic data in 
a data structure, for example coordinates which 



represent the current position of the vehicle and 
coordinates which represent a calculated optimum 
route to be followed. In module 22 this navigation 
data is subjected to a transformation in accordance 
5 with the position of the image pick-up unit 24 with 
respect to the environment: the relevant area of the 
data structure containing the topographic data is 
"viewed" from the point of view of the image pick- 
up unit as described in the previously filed, non- 
70 prepublished Netherlands Patent Application No. 
8900056 (= PHN 12.810). Navigation data to be 
displayed, for example indications of the route to 
be followed, thus correspond to the roads in the 
local image of the environment. Module 23 is a 
75 video generator which forms an indication signal 
from the transformed navigation data: for example, 
a stylistic indication of the route to be followed. 
Image pick-up unit 24 (a video camera or television 
camera) supplies an image of the environment. In a 
20 combination module 25 the indication signal and 
the environment image are combined so as to form 
a combined signal which is displayed on display 
unit 26 (a video display, television receiver or mon- 
itor). 

25 Fig. 3 shows an example of a display of an 

image of the environment in combination with styl- 
ized navigation data. The arrow indicates the direc- 
tion to be followed as calculated by the navigation 
system: in this case indication to turn left, which 

30 indication is overlaid on the road section to be 
followed. When the navigation data is displayed in 
a distinct manner, for example in a flashing or 
boxed manner, or in a bright colour which is dis- 
tinct from the remainder of the image, the user will 

35 see how to act at one glance. 

In the CARIN data base roads are represented by 
the coordinates of their centre lines. For a realistic 
display on a display unit, it is important to convert 
this representation into a representation by way of 

40 polygons which is compatible with the realistic im- 
age of the environment To this end, the structure 
in the CARIN data base is converted into a new 
structure whose most important categories are: 

- nodes (P), each of which is represented by two 
46 coordinates (or three coordinates if the data base 

also contains information as regards altitude); 

- roads (R), each of which is represented by the 
number and location of the constituent nodes; 

- links (L), each of which is represented by the 
60 associated road and its direction; 

- intersections (I), each of which is represented by 
the number and the location of the constituent 
links. 

The category of links is extended to p-links 
55 (PL) by including also the left-hand and the right- 
hand side of the road; the list of roads and nodes 
is thus increased (the left-hand and the right-hand 
side of the road also constitute a separate road 
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defined by nodes), but the 'structure remains the 
same, see Fig. 4. 

Subsequently, for each intersection the links lead- 
ing thereto are sorted in a counterclock-wise fash- 
ion. This is realised as follows: the first link LO 
referred to acts as a reference. If the angle be- 
tween this link LO and the next link L1 is greater 
than the angle between LO and the subsequent link 
L2. L1 and L2 are interchanged in the list of links, 
see Rg. 5. The cosine and the sine of the angle aO 
enclosed by the link LO with respect to the positive 
X-axis are: 

cos(aO) = (xOB - xOA) / SQRT ((xOB - xOA) 2 + 
(yOB - yOA) 2 ); 

sin(a0) = (yOB - yOA) / SQRT ((xOB - xOAf + 
(yOB - yOA) 2 ); 

and the same is applicable to the links L1 and L2. 
It follows therefrom that 

cos(a10) = cos(al-aO) = cos(a1 )*cos(aO) + sin- 
(a1)*sin(a0); 

sin(a10) = sin(al-aO) = sin(a1)*cos(a0) - cos(a1)- 
*sin(aO); 

and the same is applicable to cos(a20) and sin- 
(a20). 

The sequence is then determined as follows: 

if sin(a10) > 0 

subsequently if sin(a20) > 0 

subsequently if cos(a10) > cos(a20) 

do not interchange, 

and otherwise interchange 

otherwise do not interchange 

otherwise if sin(a20) > 0 

interchange 

otherwise rf cos(a10) < cos(a20) 
do not interchange 
otherwise interchange. 

Subsequently, for each intersection the centre 
line of all links departing from the respective inter- 
section is converted into a polygon, see Rg. 6. 

For all points, except for the terminal points, 
the point of intersection of adjoining left-hand and 
right-hand road sides is calculated. The vector hav- 
ing the length D1, perpendicular to PQ, is given by: 
(xpq,ypq), where xpq = -<yq-yp)*gpq and ypq = 
(xq-xp)*gpq, where gpq = D1 / SQRTtfxq-xp) 2 + 

(yq-yp) 2 ). 

To the vector perpencidular to QR, having the 
length D2 t an analogous expression is applicable: 
(xqr.yqr), where xqr = -(yr-yqrgqr and yqr = (xr- 
xq)*gqr, where gqr = D2 / SQRT((xr-xq)2 + ( yr - 

yq) 2 ). 

The point of intersection (xs.ys) searched is the 
point of intersection of the line between 
(xp + xpg,yp + ypg) and (xq + xpq.yq + ypq) and the 
line between (xq+xqr, yq + yqr) and (xr + xqr, 
yr + yqr). 

The following is applicable: 

xs = xpq + n*xp + (1-n)«xq and ys = ypq + n*yp + (1- 



n)*yq ; 

xs = xqr + m*xq + (1 -m)*xr and ys = yqr + m*yq + - 
(1-m)-yr ; 

solution of these equations for the parameter n 
s results in: 

n = [ (yq-yr)*(xpq + xq-xqr-xr) - (xq-xr)*(ypq + yq- 
yqr-yr) ) / ... 

... / [(xq-xrHyp-yq) - (yq-yr)*(xp-xq) ] 

If the denominator is zero, the two line segments 

io are situated one in the prolongation of the other 
and the parameter n is assumed to equal zero. 
The point of intersection (xs.ys) has thus been 
found. Each centre line has thus been supplemen- 
ted so as to form a real street having a given width. 

75 Rnally, all polygons thus found are coupled to 

the associated intersections. Because the links 
have been sorted while proceeding counterclock- 
wise, each time the point of intersection of the left- 
hand edge of a link with the right-hand edge of the 

20 next link is calculated. The calculations are fully 
analogous to the foregoing. 

The network of roads consisting of "dashed 
roads" has thus been converted into a network of 
"real" roads. The navigation data can now be posi- 

25 tioned so as to correspond better to the image of 
the environment. 



Claims 

30 

1. A method of displaying navigation data for a 
vehicle in an image of the local vehicle environ- 
ment, characterized in that an image of the local 
vehicle environment is generated by an image 

35 pick-up unit which image is displayed on a display 
unit an indication signal formed from the naviga- 
tion data being superposed on the image. 

2. A method as claimed in Claim 1 where the 
navigation data is generated by a navigation sys- 

40 tern on the basis of measurement data from sen- 
sors and/of topographic data from a data structure, 
characterized in that before formation of the indica- 
tion signal, the navigation data is transformed in 
conformity with a position of the image pick-up unit 

45 with respect to the environment 

3. A method as claimed in Claim 2, characterized 
in that the navigation data is transformed by way of 
a perspective transformation. 

4. A method as claimed in any one of the Claims 1 
so to 3. characterized in that the display unit displays 

the navigation data so as to be distinct 

5. A method as claimed in any one of the Claims 1 
to 4, where the navigation data is generated by a 
navigation system on the basis of measurement 

55 data from sensors and topographic data from a 
data structure in which roads are represented by 
coordinates of their centre lines, characterized in 
that prior to the formation of the indication signal 
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from the navigation data the representation of the 
roads is converted into a representation by poly- 
gons. 

6. A navigation system suitable for performing a 
method as claimed in any one of the Claims 1 to 5. 5 
characterized in that the navigation system com- 
prises an image pick-up unit which generates an 
image of the local environment, a transformation 
module for transforming navigation data generated 

by the navigation system, a video generator for 10 
generating an indication signal from the trans- 
formed navigation data, a combination module for 
combining the image of the environment and the 
indication signal so as to form a combined signal, 
and a display unit for displaying the combined ts 
signal. 

7. A vehicle comprising a navigation system as 
claimed in Claim 6. 
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